Data Parallel Language Extensions for Exploiting Locality in Irregular Problems
نویسندگان
چکیده
Many large-scale computational applications contain irregular data access patterns related to unstructured problem domains. Examples include nite element methods, computational uid dynamics, and molecular dynamics codes. Such codes are diicult to parallelize ef-ciently with current HPF compilers. However, most of these problems exhibit spatial locality. This property is exploited by our approach. In the sequential program, unstructured domains are accessed via in-direction arrays. We introduce a new directive that serves to identify indirection arrays and the boundaries of the associated domains. The data domains are distributed using Multiple Recursive Decomposition (MRD), a pseudo-regular distribution, which combines eecient implementation with good load balancing and communication behavior. Indi-rection arrays are aligned with the data arrays. Using the information provided in the directive, the compiler can produce a target program with signiicantly better performance than an approach based on indirect distributions and the inspector/executor paradigm.
منابع مشابه
Irregular data-parallelism in a parallel object-oriented language by means of Collective Replication
In parallel object-oriented languages it is hard to elegantly express efficient data-parallel operations on objects of an irregularly-shaped object structure that is spread across the parallel computing environment. This paper presents a new programming model that smoothly integrates both task and data parallelism in a distributed object-oriented context. So called Collective Replication combin...
متن کاملCompiler Support for Machine Independent Parallelization of Irregular Problems Compiler Support for Machine Independent Parallelization of Irregular Problems
The Fortran D group at Rice University aims at providing a machine independent data parallel programming style, in which the applications programmer uses a dialect of sequential Fortran and high level distribution annotations. Extracting parallelism from these applications typically is straightforward, but making eecient use of this par-allelism for irregular applications, such as molecular dyn...
متن کاملExploiting Locality on Parallel Sparse Matrix Computations
By now, irregular problems are di cult to parallelize in an automatic way because of their lack of regularity in data access patterns. Most times, programmers must hand-write a particular solution for each problem separately. In this paper we present two pseudo-regular distributions which can be applied to partition most problems achieving very good average case distributions. Also, we have des...
متن کاملData-parallel support for numerical irregular problems
A large class of intensive numerical applications show an irregular structure, exhibiting an unpredictable runtime behavior. Two kinds of irregularity can be distinguished in these applications. First, irregular control structures, derived from the use of conditional statements on data only known at runtime. Second, irregular data structures, derived from computations involving sparse matrices,...
متن کاملValue - Based Distributions and Alignments in Fortran DReinhard
Compiling irregular applications written in a data-parallel language, like Fortran D or High Performance Fortran (HPF), presents a challenge of growing importance. A major component of data-parallel programming is the data mapping, i.e., data distribution and alignment. Map-pings may be either regular, in which case they correspond to simple functions between array indices and owning processors...
متن کامل